Attribute selection surface for use with a pen

ABSTRACT

An attribute selection surface for use with a pen is provided. The pen has an electronically controllable marking device and a sensor. The surface comprises a substrate having information disposed thereon, the information comprising human-readable attribute information and coded data adapted to be sensed by the sensor of the pen.

CROSS REFERENCE TO RELATED APPLICATION

The present application is a divisional of U.S. application Ser. No.10/274,817 filed Oct. 21, 2002 now U.S. Pat. No. 7,015,901 which is acontinuation of U.S. application Ser. No. 09/693,216 filed on Oct. 20,2000, now issued as U.S. Pat. No. 6,474,888, the entire contents ofwhich are herein incorporated by reference.

FIELD OF INVENTION

The present invention relates to implements for placing markings, suchas writing and drawings, on substrates, and more particularly to devicescapable of placing markings with selectable characteristics, such ascolor, line width, and style. Marking includes the deposition ofmaterial, such as ink or toner, or the modification of the substrateitself, such as by thermal or electrostatic means.

CO-PENDING APPLICATIONS

Various methods, systems and apparatus relating to the present inventionare disclosed in the following co-pending applications/granted patentsfiled by the applicant or assignee of the present invention with thepresent invention:

7190474 7110126 6813558 6965454 6847883 7131058 09/693690 69827986474888 6627870 6724374 09/693514 6454482 6808330 6527365 64747736550997The disclosures of these co-pending applications are incorporated hereinby cross-reference.

Various methods, systems and apparatus relating to the present inventionare disclosed in the following co-pending applications/granted patentsfiled by the applicant or assignee of the present invention on 15 Sep.2000: U.S. Pat. Nos. 6,679,420 6,963,845 6,995,859 6,720,985

The disclosures of these co-pending applications are incorporated hereinby cross-reference.

Various methods, systems and apparatus relating to the present inventionare disclosed in the following co-pending applications/granted patentsfiled by the applicant or assignee of the present invention on 30 Jun.2000:

6824044 6678499 6976220 6976035 6766942 09/609303 6922779 697801909/607843 6959298 6973450 7150404 6965882 7233924 7007851 69579216457883 6831682 6977751 6398332 6394573 6622923The disclosures of these co-pending applications are incorporated hereinby cross-reference.

Various methods, systems and apparatus relating to the present inventionare disclosed in the following co-pending applications/granted patentsfiled by the applicant or assignee of the present invention on 23 May2000:

6428133 6526658 6315399 6338548 6540319 6328431 6328425 6991320 63838336464332 6390591 7018016 6328417 09/575197 7079712 09/575123 682594509/575165 6813039 6987506 7038797 6980318 6816274 7102772 09/5751866681045 6728000 7173722 7088459 09/575181 7068382 7062651 67891946789191 6644642 6502614 6622999 6669385 6549935 6987573 6727996 65918846439706 6760119 09/575198 6290349 6428155 6785016 6870966 68226396737591 7055739 7233320 6830196 6832717 6957768 09/575172 71704997106888 7123239 6409323 6281912 6604810 6318920 6488422 6795215 71546386859289The disclosures of these co-pending applications are incorporated hereinby reference.

BACKGROUND

Current drawing and writing implements such as pens and pencils arerelatively static devices in relation to the characteristics of themarking that they produce. A pencil, fountain or ball type pen generallyhas a single marking point which deposits a single color of lead or ink.The marking point of a pen cannot be modified other than by replacementand any modification of the characteristics of markings made rely on theuser changing the orientation of the implement, the direction ofmovement and the force applied to the substrate. Whilst some ball typepens are available with multiple separate cartridges, these merelyprovide the user with the ability to select a particular color. Becauseeach color is provided by a separate cartridge, there is a limit on thenumber of colors which may be practically provided.

SUMMARY OF INVENTION

In an attempt to provide a writing or marking implement with increasedutility, the present invention, in one broad form, provides a pen or acartridge for a pen including an inkjet type printhead as an alternativeto a conventional nib or point of a pen or pencil. The provision of aninkjet type printhead enables more variation of and easier control overthe characteristics of the markings made as compared to conventionalpens and pencils.

The invention also provides, in one broad form, a pen including amarking device and operative to mark a visible path onto a surface, themarking device electronically controllable to change at least oneattribute of the path, the pen including a user interface whereby a usermay modify the at least one attribute.

The marking device may be integral with the pen or may be part of a userreplaceable cartridge.

Accordingly, in one broad form, the invention also provides a cartridgefor a pen, the cartridge including a marking device and operative tomark a visible path onto a surface, the marking device electronicallycontrollable to change at least one attribute of the path.

The pen or the cartridge may include a non marking stylus nib. Thestylus nib is preferably movable along a first axis relative to thecartridge body or pen. Alternatively, the stylus nib may be fixed. Inthe preferred form the stylus and marking device are both part of a userreplaceable cartridge but the stylus nib may be part of the pen and themarking device part of a disposable cartridge.

A position sensor which senses the relative position of the stylus nib,or a force sensor which senses the compressive force applied to thestylus nib, or both, may be provided. The information sensed may be usedmerely to turn the marking device on or off or it may also be used tocontrol an attribute of the path deposited.

An on/off switch may be turned to an “on” state upon sensing of morethan a predetermined amount of movement of the stylus nib or applicationof more than a predetermined compressive force to the stylus nib.

The marking device preferably includes a capper device movable betweenan open position, in which the printhead may deposit ink on the surface,and a closed position in which the capper blocks the printhead fromdepositing ink.

In the preferred form the capper device rotates about an axis betweenthe open and closed positions. Preferably this movement is achieved bymovement of the stylus nib.

In a preferred embodiment there is a stylus nib movable along a firstaxis which includes a slot or groove extending at other than 0° or 90°to the first axis. A capper device is mounted in front of the markingdevice and is rotatable about a second axis parallel to the first axisbetween an open and closed position. The capper device includes an armengaging the slot or groove, whereby movement of the stylus nib alongthe first axis moves the capper device between the open and closedpositions.

The cartridge or pen may include a power source for at least the markingdevice and preferably for the user interface. The power source may be adisposable battery or a rechargeable battery.

Where a cartridge is provided, the cartridge preferably includes anelectrical input for receiving at least one control signal for changingthe at least one attribute from the pen.

The marking device may act onto the surface or a transfer device may beprovided onto which the marking device acts.

Where a cartridge is provided, the cartridge may include non volatilememory which stores at least data relating to the modifiable attributeor attributes.

The marking device is preferably an ink ejection type printhead butother marking devices may be used.

The invention in a further embodiment provides a pen including a markingdevice and operative to mark a visible path onto a surface, the markingdevice electronically controllable to change at least one attribute ofthe path, the pen including a user interface whereby a user may modifythe at least one attribute, and at least one sensing device for sensingimages or colors or both.

At least one attribute may be modified, based on the sensed image orcolor.

The pen preferably includes a memory for storing at least one userdefined set of attributes and a user defined set optionally includesattributes derived from an image or color sensed by the sensing device.

One of the sensor device(s) may be capable of sensing images includingcoded data relating to attributes.

The sensing device may be located adjacent the marking device or belocated at one end of the pen with the marking device located at theother end of the pen.

The sensing device is preferably operable by pushing the device againsta surface.

The user interface may include at least one slider or at least onecontrol button or at least one slider and at least one control button.

The user interface may include a display for displaying informationrelating to the at least one attribute.

The user interface is preferably operable to cycle through the storedsets of at least one attribute.

The invention also provides a pen including a marking device andoperative to mark a visible path onto a surface, the marking deviceelectronically controllable to change at least one attribute of thepath, the pen including a user interface whereby a user may modify theat least one attribute and at least one sensor device capable of sensingimages including coded data.

The pen preferably includes a decoder to decode the coded data and tochange at least one attribute in response to the decoded data.

The pen may include a receiver for receiving commands from an externalcontrol source, at least one attribute being changed in response to saidreceived commands.

The pen preferably includes a memory for storing different sets ofattribute values. The memory may store at least one user defined set ofthe at least one attribute.

The pen preferably includes a transmitter for transmitting sensed imagedata, coded data or decoded data to an external control source.

The pen preferably transmits sensed image data, coded data or decodeddata to an external control source together with the value or values ofthe at least one attribute of the path at the location of the sensedimage.

The pen may include a position sensing device or a motion sensing deviceor both and at least one attribute is dependant on the relative positionof the pen, the relative speed of the pen or both.

The position or speed of the pen may be derived from the sensed positionof the images or it may be derived from the data encoded in the sensedimages.

The invention also provides, in one broad form, an ink ejection typeprinthead having a plurality of ink ejection devices and a central axis,the ink ejection devices arranged in a series of groups, each of thegroups generally extending along non parallel lines.

Adjacent ink ejection devices of each group may be located on alternatesides of a radial line or on a radial line.

A set of the devices may be connected to a common supply of ink.Preferably each set includes devices of more than one group and morepreferably each set has a different ink supply to the other sets. Thedevices of a group are preferably part of the same set and adjacentgroups belong to different sets.

The groups of different sets are preferably arranged in a repeatingpattern.

Preferably there are four sets and twelve groups.

Preferably each group of devices is supplied with ink from a commongallery, all of the galleries being at a first level in the printhead,galleries for a set of devices being interconnected in part by at leastone interconnecting passageway at a second level, the interconnectingpassageways of each set passing beneath galleries of at least one otherset.

The printhead preferably includes a first layer of solid material, anink ejection device layer above the first layer and a second layer ofsolid material below the first layer.

The galleries are preferably slots extending through the thickness ofthe first layer and preferably the interconnecting passageways aregrooves in the lower surface of the second layer which extend onlypartway through the thickness of the second layer.

Preferably the second layer includes linking passageways linking thegalleries with the interconnecting passageways, the linking passagewaysextending through the thickness of the second layer.

The first, second and an ink ejection device layers are discrete layersor part of an integral device.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 shows a perspective view of a pen according to a first embodimentof the invention.

FIG. 2 shows a plan view of the pen shown in FIG. 1.

FIG. 3 shows a side view of the pen shown in FIG. 1.

FIG. 4 shows an end view of the pen shown in FIG. 1.

FIG. 5 shows a perspective view of a cartridge for use in the pen shownin FIG. 1.

FIG. 6 shows an exploded perspective view of the cartridge of FIG. 5.

FIG. 7 shows a side view of the nib area of the pen of FIG. 1 with paperat various orientations.

FIG. 8 shows an exploded perspective view of a cartridge for use in apen according to a second embodiment of the invention.

FIG. 9 shows an exploded perspective view of a pen according to a thirdembodiment of the invention.

FIG. 10 shows an axial cross sectional view of the pen of FIG. 9.

FIG. 11 shows a perspective view of a pen according to a fourthembodiment of the invention.

FIG. 12 shows an exploded perspective view of the pen of FIG. 11.

FIG. 13 shows an exploded perspective view of part of the pen of FIG.11.

FIG. 14 shows a first exploded perspective view of part of the cartridgeof FIGS. 5, 6 & 8.

FIG. 15 shows a second exploded perspective view of part of thecartridge of FIGS. 5, 6 & 8.

FIG. 16 shows a plan view of the printhead used in the cartridges ofFIGS. 5, 6 & 8.

FIG. 17 shows a perspective view from above of the printhead of FIG. 16in an open position.

FIG. 18 shows a perspective view from above of the printhead of FIG. 16in a closed position.

FIG. 19 shows a perspective cross sectional view from above of theprinthead of FIG. 16 in an open position.

FIG. 20 shows a perspective view from below of the printhead of FIG. 16in an open position.

FIG. 20 a shows a plan view from below of the printhead of FIG. 16 in anopen position.

FIG. 21 shows an exploded perspective view from above of the printheadof FIG. 16 in an open position.

FIG. 22 shows a perspective view from above of the MEMS inkjet layer ofthe printhead of FIG. 16.

FIG. 23 shows a perspective view of a pen according to a furtherembodiment of the invention.

FIG. 24 shows a perspective view of a pen according to a furtherembodiment of the invention.

FIG. 25 shows a perspective view of a pen according to a furtherembodiment of the invention.

FIG. 26 shows a perspective view of a pen according to a furtherembodiment of the invention.

FIG. 27 shows a color card for use with various embodiments of theinvention.

FIG. 28 shows a perspective view of a pen according to a furtherembodiment of the invention with a cap on.

FIG. 29 shows a perspective view of the pen of FIG. 28 with the cap off.

FIG. 30 shows an exploded perspective view of the FIG. 29 pen.

FIG. 31 shows an exploded perspective view of parts of the FIG. 29 pen.

FIG. 32 shows another exploded perspective view of parts of the FIG. 29pen.

FIG. 33 shows another exploded perspective view of parts of the FIG. 29pen.

FIG. 34 shows a perspective view of a pen according to a furtherembodiment of the invention.

FIG. 35 is a schematic of a the relationship between a sample printednetpage and its online page description.

FIG. 36 is a schematic view of a interaction between a netpage pen, anetpage printer, a netpage page server, and a netpage applicationserver.

DETAILED DESCRIPTION OF PREFERRED AND OTHER EMBODIMENTS

Note: Memjet™ is a trademark of Silverbrook Research Pty Ltd, Australia.

Basic Pen & Cartridge Construction

FIGS. 1 to 6 show a pen 1110 according to a first embodiment of theinvention. The pen has a generally tubular pen body 1112 in which islocated a replaceable cartridge assembly 1114. The cartridge 1114includes an ink supply 1116, stylus nib 1118 and printhead 1120 and isdesigned to be discarded when the ink supply is expended or the stylusor printhead are damaged, with a new cartridge being inserted into thepen body. However the pen may be manufactured as a throw-away item withthe cartridge and pen body integral or not end user separable.

The ink supply 1116 comprises an elongate hollow tube 1122 which isclosed at one end by a first end cap 1124 and at the other end by asecond end cap 1126. The tube 1122 is preferably made of athermoplastics material but may be made of other materials. When made ofa plastics material the tube is preferably extruded so as to have aconstant cross sectional profile. However the tube may be injectionmolded. If made of metal, the tube may be also extruded. The tube 1122has a number of ribs 1128 which divide the interior of the tube intofour separate chambers 1130, 1132, 1134 & 1136. These ribs also providerigidity. The chambers are filled with ink. At its simplest the chambersall have the same colored ink. Alternatively there may be differentcolored inks in each chamber. With four colors and a suitable printheadit is possible to produce almost any desired color using a combinationof Cyan, Magenta, Yellow and BlacK (CMYK) color inks.

The chamber 1130 occupies approximately half of the tube volume whilstthe three remaining chambers each occupy one sixth of the tube volume.In a CMYK color printing device black is normally printed more thancolor and so black ink would be stored in chamber 1130 with the threeother colors stored in chambers 1132, 1134 & 1136. It will beappreciated that the number and relative volumes of the chambers may bevaried as desired. Some current desktop ink jet printers utilize sixdifferent colored inks in addition to black and, if desired, the tubemay be divided into seven chambers. The colored ink chambers need notall have the same volume and the black ink chamber (if black ink isused) need not have half of the available volume. As color becomes moreaccessible, the proportion of printing using black ink may decrease andso the ratio of black ink to colored ink may change. Similarly, whilstcolor inks are supplied in equal amount, there is no reason why, forinstance, that a larger supply of magenta could not be provided.

The first end cap 1124 is shaped to substantially seal the ends of eachof the chambers. The end cap 1124 includes small air inlets 1140 toallow air into the chambers as the ink is used. To prevent drying of theinks through evaporation (the inks used are usually water based) amovable seal, not shown, is provided between the ink and the end cap1124. As ink is used, the seal moves along the respective chamber.

The second end cap 1126 is also shaped to substantially seal each of thechambers but is provided with ink galleries 1178 (see FIG. 15) whichcommunicate the chambers with the printhead 1120, bonded to the free endof the cap 1126. The printhead is preferably an ink jet type printheadand more preferably a microelectromechanical system (MEMS) based inkjet.MEMS based inkjets expel ink using mechanical actuators rather than byheating of the ink, as currently used by most ink jet type printerscurrently available. As such MEMS based inkjets have a lower powerconsumption compared to such printers, which makes them attractive foruse in portable devices where available power is limited. For a betterunderstanding of MEMS ink jet devices and methods of fabrication,reference is made to our earlier U.S. application Ser. No. 09/575,141(IJ052US), the contents of which are incorporated herein by reference.

The printhead is bonded to the end cap 1126 but mounted on a flexibleprinted circuit board (PCB) 1114 which includes control and powercontacts 1146.

A stylus nib 1118 is mounted on the end cap 1126 so as to be capable ofa small amount of axial movement. Axial movement of the stylus nib 1118is controlled by integral arms 1148 which extend laterally and axiallyaway from the inner end of the stylus to bear against a land 1184 (seeFIG. 15). In use, pressing the stylus against a substrate causes thearms 1148 to bend and allows the stylus to retract. The stylus ispreferably formed by injection molding of a thermoplastic material, mostpreferably Acetyl. This movement is typically a maximum of amount 0.5 mmand provides some feedback to the user. In addition the flexibility ofthe stylus nib accommodates a small amount of roughness in the substratesurface. If desired the stylus nib may be fixed with substantially nomovement allowed.

The first end cap 1124 is shaped to receive a small button or cylindertype battery 1138. The battery may merely sit on the end of the end capor it may be inserted sideways into a chamber in the end cap. Locatingthe battery in a chamber enables both terminals of a button orcylindrical type battery to be easily engaged by electrical contacts inthe chamber.

Merely sitting the battery on the end only allows easy engagement withone terminal. One or two wires or other electrical paths 1139 areprovided which connect one or both terminals of the battery 1138 withthe PCB 1144.

A nib cap 1152 extends over the end cap 1126, printhead 1120, PCB 1144and stylus nib 1118 and an aperture 1154 is provided through which thefree end 1156 of the stylus nib 1118 projects. The aperture 1154 is ovalin shape and allows the printhead 1120 to expel ink though the aperturebelow the stylus nib.

The cartridge 1114 is positioned in the pen body 1112 and secured inplace by one or more resilient snap action arms 1158 integrally formedon the nib cap 1152. Where the battery 1138 is securely mounted on theend cap with both terminals in electrical connection with the PCB 1144,the cartridge need not otherwise engage the pen body 1112. Where onlyone terminal is connected to the PCB, the pen body may be used toprovide the path for the other terminal, via switches if desired, inwhich case the free end of the battery engages a terminal mounted in theclosed end 1160 of the body 1112.

In a monochrome pen the minimum functionality required to control theprinthead is an on/off switch and circuitry for controlling the ink jetactuators. The PCB or the printhead itself incorporate the controlcircuitry for the ink jet actuators. The on/off switch is preferablycontrolled so that ink is only ejected when the stylus nib is pressed ona substrate. Pressing the stylus against a substrate results in acompressive force in the stylus nib. In this embodiment this results inmovement of the stylus and the on/off switch may be activated by themovement, by sensing the compressive force or by other means. Where thestylus is substantially fixed, movement of the stylus nib relative tothe rest of the pen is not available.

The PCB and printhead circuitry may be permanently connected to thebattery or the pen may be provided with a separate “master” on/offswitch. Provision of a master on/off switch allows the user to use thepen in a non-marking mode, such as for use with a touch screen of apersonal organizer type device. Other mechanisms may be used to ensureno printing of the pen, as will be explained later. Where there is nooverride type system, such that the pen is permanently “on”, theprinthead or PCB circuitry or both preferably include “sleep mode” typecircuitry which turns off most of the electrical circuits to conservebattery power. Pressing the stylus nib results in “wake up” of theelectrical systems and printing. Being a solid state device, the delayin commencing printing caused by changing from a sleep mode to an activemode will be so small as to be unnoticed by a user. If the pen includesa motion sensing device, such as an accelerometer, then this sensor can“wake up” the pen on sensing motion above a specified threshold.

As best seen in FIGS. 1 & 3 the pen body 1112 is not symmetrical butinstead is provided with a finger grip 1162. This finger grip 1162encourages the user to hold the pen in an orientation with the stylusnib 1118 above the printhead 1120. However, the orientation of the penis not critical and the pen is configured so that the stylus nib willnot obstruct the path of ink from the printhead to the paper at anyorientation, as shown in FIG. 7.

FIG. 7 shows the stylus nib resting against paper at three differentorientations, indicated by numbers 1164, 1166 & 1168. The path of inkfrom the printhead is indicated by line 1170. Paper sheet 1164represents an orientation with the stylus nib above the printhead whilstpaper sheet 1166 represents an orientation with the stylus nib below theprinthead. Paper sheet 1168 represents an orientation with the stylusnib to the side of the printhead. As seen, the stylus nib does notobstruct the path of the ink to the paper at any orientation.

FIG. 8 shows a cartridge 1172 similar to that of FIGS. 1 to 6 exceptthat the cartridge does not include a battery. The cartridge isotherwise substantially identical to the cartridge of FIGS. 1 to 6 andso the same parts are identified with the same numbers. The maindifferences are that end cap 1174 is a simple plug and has no provisionfor receiving a battery. In addition there is no electrical connectionor wires extending to the PCB 1144.

The cartridge 1172 is intended for use in a pen body which includes apower source, either a battery or a wired connection. The body of thepen includes electrical terminals for contacting with the PCB 1144. Theink supply 1116 may be the same length as that of the self poweredembodiment or it may be a different length. The battery in the pen maybe disposable or a rechargeable type battery.

The cartridges preferably include identity information hard coded orstored in non-volatile memory which identifies one or morecharacteristics of the cartridge, such as whether the cartridge is amono or color cartridge, the maximum width of line possible, etc. Inaddition the cartridges may include circuitry for monitoring ink levelsin each chamber or for detecting when an ink has run out. Thisinformation may be made available to the pen via the contacts on the PCB1144. Alternatively the pen controller may decrement a calculated,assumed or cartridge supplied initial ink volume as printing occurs. Inone form the cartridge may store the initial ink volume in non-volatilememory and the pen may extract this information from the cartridge whenthe cartridge is installed. This enables the cartridge to be arelatively “dumb” device.

Pen with Sensor

A pen with a built-in optical sensing device is show in FIGS. 9 and 10.The pen 1200 has a body molding 1202, a chassis molding 1204 and a frontmolding 1206. The pen 1200 uses a cartridge 1208 the same as shown inFIGS. 1 to 6, i.e. a self powered disposable cartridge.

The pen also includes an optical sensing package 1210 which comprises aPCB 1212 and an optical molding 1214. The PCB 1212 includes an imagesensor device 1216, a light source device 1218, processing chips 1220,radio transmitter chip 1222, display LEDs 1224 and aerial 1226. Theaerial 1226 is connected to the PCB 1212 via wire 1228. The PCBoptionally includes an accelerometer 1230. The image sensor device 1216may be responsive to a narrow band of electromagnetic wavelengths or toa wide band. The light source device 1218 emits electromagneticradiation at some or all of the wavelengths to which the sensor deviceresponds. The image sensor device 1216 is preferably comprised of one ormore charge coupled devices (CCD) or complementary metal oxidesemiconductor (CMOS) image sensors. The light source 1218 is preferablycomprised of one or more LEDs which emit electromagnetic radiation atone or more pre-selected wavelengths. The light sources and imagesensors may be provided with one or more filters to filter out unwantedwavelengths. In some circumstances it may be desirable to have a firstset of image sensors responsive only to infrared radiation and a secondset only responsive to visible light. Similarly it may be desirable tohave a first set of light sources which emit only to infrared radiationand a second set which emit only visible light. Other combinations ofwavelengths are possible and the device may be responsive to more thattwo bands of wavelengths.

In brief summary, the preferred form of the netpage system employs acomputer interface in the form of a mapped surface, that is, a physicalsurface which contains references to a map of the surface maintained ina computer system. The map references can be queried by an appropriatesensing device. Depending upon the specific implementation, the mapreferences may be encoded visibly or invisibly, and defined in such away that a local query on the mapped surface yields an unambiguous mapreference both within the map and among different maps. The computersystem can contain information about features on the mapped surface, andsuch information can be retrieved based on map references supplied by asensing device used with the mapped surface. The information thusretrieved can take the form of actions which are initiated by thecomputer system on behalf of the operator in response to the operator'sinteraction with the surface features.

In its preferred form, the netpage system relies on the production of,and human interaction with, netpages. These are pages of text, graphicsand images printed on ordinary paper, but which work like interactiveweb pages. Information is encoded on each page using ink which issubstantially invisible to the unaided human eye. The ink, however, andthereby the coded data, can be sensed by an optically imaging pen andtransmitted to the netpage system.

In the preferred form, active buttons and hyperlinks on each page can beclicked with the pen to request information from the network or tosignal preferences to a network server. In one embodiment, text writtenby hand on a netpage is automatically recognized and converted tocomputer text in the netpage system, allowing forms to be filled in. Inother embodiments, signatures recorded on a netpage are automaticallyverified, allowing e-commerce transactions to be securely authorized.

As illustrated in FIG. 35, a printed netpage 1 can represent ainteractive form which can be filled in by the user both physically, onthe printed page, and “electronically”, via communication between thepen and the netpage system. The example shows a “Request” formcontaining name and address fields and a submit button. The netpageconsists of graphic data 2 printed using visible ink, and coded data 3printed as a collection of tags 4 using invisible ink. The correspondingpage description 5, stored on the netpage network, describes theindividual elements of the netpage. In particular it describes the typeand spatial extent (zone) of each interactive element (i.e. text fieldor button in the example), to allow the netpage system to correctlyinterpret input via the netpage. The submit button 6, for example, has azone 7 which corresponds to the spatial extent of the correspondinggraphic 8.

As illustrated in FIG. 36, the netpage pen 101 works in conjunction witha netpage printer 601, an Internet-connected printing appliance forhome, office or mobile use. The pen is wireless and communicatessecurely with the netpage printer via a short-range radio link 9.

The netpage printer 601 is able to deliver, periodically or on demand,personalized newspapers, magazines, catalogs, brochures and otherpublications, all printed at high quality as interactive netpages.Unlike a personal computer, the netpage printer is an appliance whichcan be, for example, wall-mounted adjacent to an area where the morningnews is first consumed, such as in a user's kitchen, near a breakfasttable, or near the household's point of departure for the day. It alsocomes in tabletop, desktop, portable and miniature versions.

Netpages printed at their point of consumption combine the ease-of-useof paper with the timeliness and interactivity of an interactive medium.

As shown in FIG. 36, the netpage pen 101 interacts with the coded dataon a printed netpage 1 and communicates, via a short-range radio link 9,the interaction to a netpage printer. The printer 601 sends theinteraction to the relevant netpage page server 10 for interpretation.In appropriate circumstances, the page server sends a correspondingmessage to application computer software running on a netpageapplication server 13. The application server may in turn send aresponse which is printed on the originating printer.

The netpage system is made considerably more convenient in the preferredembodiment by being used in conjunction with high-speedmicroelectromechanical system (MEMS) based inkjet (Memjet.™.) printers.In the preferred form of this technology, relatively high-speed andhigh-quality printing is made more affordable to consumers. In itspreferred form, a netpage publication has the physical characteristicsof a traditional newsmagazine, such as a set of letter-size glossy pagesprinted in full color on both sides, bound together for easy navigationand comfortable handling.

The netpage printer exploits the growing availability of broadbandInternet access. Cable service is available to 95% of households in theUnited States, and cable modem service offering broadband Internetaccess is already available to 20% of these. The netpage printer canalso operate with slower connections, but with longer delivery times andlower image quality. Indeed, the netpage system can be enabled usingexisting consumer inkjet and laser printers, although the system willoperate more slowly and will therefore be less acceptable from aconsumer's point of view. In other embodiments, the netpage system ishosted on a private intranet. In still other embodiments, the netpagesystem is hosted on a single computer or computer-enabled device, suchas a printer.

Netpage publication servers 14 on the netpage network are configured todeliver print-quality publications to netpage printers. Periodicalpublications are delivered automatically to subscribing netpage printersvia pointcasting and multicasting Internet protocols. Personalizedpublications are filtered and formatted according to individual userprofiles.

A netpage printer can be configured to support any number of pens, and apen can work with any number of netpage printers. In the preferredimplementation, each netpage pen has a unique identifier. A householdmay have a collection of colored netpage pens, one assigned to eachmember of the family. This allows each user to maintain a distinctprofile with respect to a netpage publication server or applicationserver.

A netpage pen can also be registered with a netpage registration server11 and linked to one or more payment card accounts. This allowse-commerce payments to be securely authorized using the netpage pen. Thenetpage registration server compares the signature captured by thenetpage pen with a previously registered signature, allowing it toauthenticate the user's identity to an e-commerce server. Otherbiometrics can also be used to verify identity. A version of the netpagepen includes fingerprint scanning, verified in a similar way by thenetpage registration server.

Although a netpage printer may deliver periodicals such as the morningnewspaper without user intervention, it can be configured never todeliver unsolicited junk mail. In its preferred form, it only deliversperiodicals from subscribed or otherwise authorized sources. In thisrespect, the netpage printer is unlike a fax machine or e-mail accountwhich is visible to any junk mailer who knows the telephone number oremail address.

The pen 1200 may include all of the functionality of the netpage pen 101disclosed above and in our earlier applications and, in effect, be anetpage pen 101 with a controllable marking function.

Light emitted by the light source device 1218 is guided by the opticsmolding 1214 to lens 1232 and then to the substrate in use. Lightreceived by the lens is guided by the optics molding 1214 to the imagesensor device 1216. Where there are multiple light sources or imagesensors, the optics molding includes beam combiners and splitters andfilters as required. The lens is preferably part of the optics moldingand the front molding has an aperture 1233 through which light passesfrom and to the optics molding 1214. The aperture 1233 may be defined bythe lack of material or by the provision of material substantiallytransparent to the light used by the image sensing device(s) 1216.

The PCB is mounted in slots 1234 in the chassis molding 1204 with theaerial extending in a slot (not shown) in the upper surface of thechassis molding 1204. The chassis molding slides into the body moldingand is retained in position by the front molding 1206. The front molding1206 is a snap fit in the body molding with a snap fitting (not shown)engaging in recess 1236 of the body molding. The pen PCB 1212 engagesthe contacts of cartridge PCB 1144 to receive power from the batterycarried by the cartridge and to control the operation of the printhead1120. Control of the printhead depends on the application and theprocessor and will be discussed in later sections of this document.

Control of Printhead

FIGS. 11 to 13 show a pen 1250 according to a further embodiment of theinvention. The pen has a simple tubular body 1252 in which an inkcartridge 1114 is received. The cartridge 1114 may be a monochrome inkcartridge or a color cartridge. The body 1252 includes a PCB 1254 onwhich is mounted a processor chip or chips 1256 and a potentiometer1257. The potentiometer is positioned to lie under the upper surface ofthe body 1252 and is connected to an external slider 1258. The slider1258 slides in slot 1260 of the body. The PCB 1254 includes contact pads1262 which engage contacts 1146 of the cartridge 1114 to receive powerand to control the printhead 1120.

The potentiometer is capable of adjusting one characteristic of the inkdeposited by the printhead 1120. This may be the amount of inkdeposited, the width of the line produced, the color of the inkdeposited (in a color cartridge) or any other attribute.

As mentioned earlier the cartridges may include information whichidentifies one or more characteristics of the cartridge, such as whetherthe cartridge is a mono or color cartridge, the maximum width of linepossible, etc. The processor 1256 of the pen PCB 1254 can obtain thisinformation from the cartridge and change the relevant attribute of theprinthead 1120. The cartridge 1114 may include an area 1268 whichindicates the attribute that may be modified. The information may beprinted on the cartridge body directly or attached by way of a sticker.The body may include a transparent area 1264 adjacent the slider 1256through which the area 1268 is visible. Thus, for instance, a colorcartridge whose color output may be modified may have a rainbow stripeat area 1268 which is visible through area 1264. The user can select anycolor merely by sliding the slider 1258 so that index line 1266 isadjacent the required color. A mono cartridge with adjustable line widthcan have a wedge representing the line width extending axially.Obviously other attributes are controllable.

Printhead and Stylus Nib

FIGS. 14 and 15 show in detail a preferred arrangement printhead andstylus nib for use in the cartridge and pen of the present invention andas used in the cartridges of FIGS. 5, 6 & 8. As such the same parts havethe same reference numbers.

The printhead 1120 is mounted on PCB 1144 and is received in a recess1176 in end cap 1126. Both the printhead and the recess are non-circulartoo aid in correct orientation. The end cap 1126 includes four inkgalleries 1178 which each exit into the recess 1176 at ink outlets 1180.These outlets communicate with ink inlets 1182 of printhead 1120.

The stylus nib 1118 is mounted in a slot 1154 of nib cap 1152 and heldin place by surface 1190 of the end cap 1126. The cantilevered arms 1148bear against land 1185 and bias the stylus nib outwards. The frontportion 1186 of the stylus nib is circular in cross section but the backportion 1188 has a flat surface 1191 which slides over surface 1190 ofend cap 1126.

The stylus nib includes a slot 1181 which extends obliquely along theflat surface 1191. The printhead 1120 includes a rotary capper 1183. Thecapper is movable between first and second operative positions. In thefirst position the ink ejection nozzles of the printhead are covered andpreferably sealed to prevent drying of the ink in the printhead andingress of foreign material or both. In the second position the inkejection nozzles of the printhead are not covered and the printhead mayoperate. The capper 1183 includes an arm 1185′ which engages the slot1181. Thus as the stylus nib moves in and out relative to the printheadthe capper 1183 is caused to rotate. When the stylus nib is under noload and is fully extended the capper is in the first position and whenthe stylus nib is depressed the capper is in the second position. Thecapper 1183 may incorporate an on/off switch for the printhead 1120, sothe printhead can only operate where the capper is in the secondoperative position. The slot may have an oblique portion to open andclose the capper and then a portion extending axially where no movementof the capper occurs with stylus nib movement.

Printhead and Capper Construction

The construction and arrangement of the printhead 1120 and capper 1183are shown in FIGS. 16 to 24 inclusive. The printhead 1120 is an assemblyof four layers 1302, 1304, 1306 and 1308 of a semiconductor material.Layer 1306 is a layer of electrically active semiconductor elements,including MEMS ink ejection devices 1310. Layer 1306 has beenconstructed using standard semiconductor fabrication techniques. Layers1302 and 1304 are electrically inactive in the printhead and providepassageways to supply the ink to the ink ejection devices 1310 from theink inlets 1182. The layer 1308 is also electrically inactive and formsa guard with apertures 1320 above each ink ejection device 1310 to allowink to be ejected from the printhead. The layers 1302, 1304 and 1308need not be the same material as the layer 1306 or even a semiconductorbut by using the same material one avoids problems with materialinterfaces. Further, by using semiconductor material for all componentsthe entire assembly may be manufactured using semiconductor fabricationtechniques.

The printhead 1120 has four ink inlets 1182 and the ink ejection devices1310 are arranged into twelve sets, each of which extends roughlyradially outwards from the center 1300 of the printhead. Every fourthradial line of ink ejection devices 1310 is connected to the same inkinlet. Ink ejection devices connected to the same ink inlet constitute aset of ink ejection devices. The ink ejection devices 1310 are arrangedon alternate sides of a radial line, which results in closer radialspacing of their centers.(Is there any other reason?). The twelve“lines” of ink ejection devices 1310 are arranged symmetrically aboutthe center 1300 of the printhead, at a spacing of 30°. It will beappreciated that the number of “lines” of ink ejection devices 1310 maybe more or less than twelve. Similarly there may be more or less thanfour ink inlets 1182. Preferably there are an equal number of lines foreach ink inlet 1182. If a single ink is used in the cartridge the inkinlets need not feed equal numbers of “lines” of ink ejection devices.

The layer 1306 includes a tab 1311 on which there are provided a numberof sets of electrical control contacts 1312. For clarity only fourcontacts are shown; it will be appreciated that there may be more,depending on the number of different color inks used and the degree ofcontrol desired over each individual ink ejection device 1310 and otherrequirements. The printhead is mounted on the PCB 1144 by bonding thetab onto the PCB 1144. The electrical contacts 1312 engage correspondingcontacts (not shown) on the PCB 1144. The layer 1306 includes controlcircuitry for each ink ejection device to control the device when turnedon. However, generally, all higher level control, such as what colorinks to print and in what relative quantities, is carried out externallyof the printhead. This may be by circuitry on the PCB 1144 or pen PCBssuch as 1212 of the FIGS. 9 & 10 device or 1254 of the FIG. 11, 12 & 13device. These higher level controls are passed to the printhead 1120 viacontacts 1312. There is preferably at least one set of contacts 1312 foreach set of ink ejection devices. However each line or each individualink ejection device may be addressable. At its simplest, each set may bemerely turned on or off by the control signals.

As seen in FIG. 16 in plan view the printhead 1120 has a substantiallyoctagonal profile with tabs 1314 and 1316 extending from opposite facesof the octagon. It will be noted that tab 1314 is formed of layers 1302,1304 and 1306 only, whilst tab 1316 is formed of all four layers 1302,1304, 1306 and 1308. This enables the PCB 1144 to be bonded to the layer1306 without extending above the top of layer 1308. The octagonal shapewith tabs also aids in locating the printhead in the recess 1176 in theend cap 1126.

The capper 1183 is also preferably formed of the same semiconductormaterial as the print head and is mounted on the printhead for rotationabout the printhead's center 1300. As with the non electrically activelayers, the capper need not be the same material as the print head oreven be a semiconductor. The capper may be rotated between an openposition (see FIG. 17) and a closed position (see FIG. 18). The openposition is shown, with the closed position shown in dotted outline inFIGS. 16 and 18. The capper 1183 has twelve radially extending apertures1318. These apertures are sized and arranged so that in the openposition all of the ink ejection devices are free to eject ink throughthe apertures. In the closed position the apertures 1318 overliematerial between the lines of ink ejection devices, and the material ofthe capper between the apertures 1318 overlies the apertures 1320 in theupper layer 1308. Thus ink cannot escape from the printhead and foreignmaterial cannot enter into the apertures 1320 and the ink ejectiondevices to possibly cause a blockage. The apertures 1318 are preferablyformed in the capper 1183 using standard semiconductor etching methods.In the embodiment shown, each aperture is equivalent to a series ofoverlapping cylindrical bores, the diameter of which is a function ofradial distance from the capper's center 1300. Alternatively, theapertures may be defined by two radially extending lines at a smallangle to each other. It will be appreciated that the outside of thecapper moves more than the inside when rotated so the apertures need toincrease in width as the radial distance increases.

The capper is substantially planar with eight legs 1322 extendingdownwards from the periphery of the lower surface 1326. These legs arespaced equally about the circumference and engage in corresponding slots1328 formed in the peripheral edge of the upper surface 1329 of theupper layer 1308. The slots are rectangular with rounded inner corners.The inner surface 1330 of the slots 1328 and the inner surface of thelegs may be arcuate and centered on the printhead's center 1300 to aidin ensuring the capper rotates about the central axis 1300. However thisis not essential. In the embodiment shown, each face of the octagon hasa slot 1328 but this is not essential and, for instance, only alternatefaces may have a slot therein. The symmetry of the legs 1322 and slots1328 is also not essential.

Rotation of the capper is caused by engaging arm 1185′ in the angledslot 1181 in the stylus nib. Rotation of the capper is ultimatelylimited by the legs 1322 and slots 1328. To prevent damage to thecapper, printhead or the stylus nib, the arm 1185′ has a narrowedportion 1334. In the event that the stylus nib is pushed in too far, thearm 1185′ flexes about the narrowed portion 1334. In addition, guardarms 1336 are provided on either side of the arm 1185′ and also serve tolimit rotation. The recess 1176 into which the printhead is inserted hasan opening in which the guard arms are located. If for some reason thecapper is rotated too much, the guard arms contact the side of theopening and limit rotation before the legs 1322 contact the ends of theslots 1328.

Printhead Actuation

Whilst the pen may be turned on, it is desirable that the print headonly actuate when the stylus nib is pressed against a substrate. Thestylus nib may cause a simple on-off switch to close as it moves intothe pen. Alternatively, a force sensor may measure the amount of forceapplied to the stylus nib. In this regard the cantilevered arms 1148 maybe used directly as electrical force sensors. Alternatively, a discreteforce sensor may be acted upon by the inner end of the stylus nib. Wherea force sensor is utilized, it may be used merely to turn the printheadon or off or to (electronically) control the rate of ink ejection with ahigher force resulting in a higher ejection rate, for instance. Theforce sensed may be used by a controller to control other attributes,such as the line width. Rotation of the capper may also cause an on/offswitch to change state.

Printhead Ink Passageways

The printhead has the different color ink ejection devices arrangedradially and this presents problems in supplying ink to the ejectiondevices where the different color ink ejection devices are interleaved.In conventional printers the ink ejection devices are arranged inparallel rows and so all the different inks may be supplied to each rowfrom either or both ends of the row. In a radial arrangement this is notpossible.

The rear surface of the bottom layer 1302 is provided with four inkinlets 1182. These inlets are oval shaped on the rear surface forapproximately half the thickness of the layer 1302 and then continue asa circular aperture 1340 through to the upper surface. The rear surfaceof the layer 1302 also has four grooves 1342, 1344, 1346 and 1348located in the central region. There are a number of holes that extendfrom the grooves through the layer 1302 (see FIGS. 21 and 24). The lowersurface of the lower layer 1302 seals against the end cap 1126 so thesegrooves define sealed passageways.

As mentioned above, there are four ink inlets and twelve lines of inkejection devices 1310, so three lines of ink ejection devices need toreceive ink from the same ink inlet. Referring to FIG. 21, a first setof three lines of ink ejection devices is numbered as 1370, 1371 & 1372.This set receives ink supplied by ink inlet 1182 a. The second layer1304 has a slot 1350 extending through its thickness under the line ofink ejection devices. The outer end of the slot 1350 is aligned with theink inlet 1182 a and so supplies ink to the devices of line 1370 aboveit, as seen in FIG. 19. The other end of the slot 1350 aligns with hole1356 in layer 1302 to communicate with groove 1342. The ends of groove1342 have holes 1358 & 1360 to the upper surface and these communicatewith slots 1352 and 1354, respectively. These slots supply ink to lines1371 and 1372, respectively. The supply of ink from opposing ink inlet1182 c to respective lines 1376, 1377 & 1378 of ink ejection devices isaccomplished with a mirror image of the slots and grooves.

Ink inlet 1182 b communicates with slot 1362 and so supplies line 1373of ink ejection devices. The inner end of slot 1362 communicates withhole 1364 in layer 1302. This hole 1364 communicates with groove 1344.The other end of groove 1344 has a hole 1366 extending to the uppersurface which communicates with slot 1368. The slot 1368 extends underlines 1374 and 1375 of ink ejection devices and so all three linesreceive the same ink. The supply of ink from inlet 1182 d to the lines1379, 1380 & 1381 is achieved with a mirror image arrangement of slotsand grooves.

Control of Attributes of Printed Ink

Color Control Via Potentiometers

FIG. 23 shows a four color pen 1400 having a pen body 1402 and areplaceable four color ink cartridge 1114. The pen body 1401 includesthree rotary potentiometers 1404, 1406 & 1408. The potentiometerscontrol the hue, saturation and brightness value respectively. The penbody also includes a display 1410 which displays a color correspondingto the settings. The display 1410 is preferably an organic lightemitting diode (OLED) display capable of displaying the required colors.Alternatively, the display may be a combination of several differentcolored pulse width modulated LEDs or a color LCD. A passive display maybe provided with a graphical representation of the effect of eachcontrol printed on the surface adjacent the respective control. Afurther variation provides a display which outputs numeric values ofHve, Saturation and Value (HSV) or text. The display may be omitted andthe user may merely rely on drawing a sample line to obtain the desiredattributes. The potentiometers may be linear rather than rotarypotentiometers.

It will be appreciated that other color control models may be used.Instead of controlling HSV the potentiometers may control Red, Green, &Blue (RGB) attributes or the relative amounts of Cyan, Magenta andYellow (CMY) inks deposited. The pen may be provided with an ability toallow the potentiometers to change any of HSV, RGB or CMY.

Color Control Via Cycle Buttons

FIG. 24 shows a pen 1420 including a pen body 1422 and a replaceablefour color ink cartridge 1114. The pen body 1422 includes a colordisplay 1424, preferably an OLED and three control buttons 1426, 1428 &1430. The pen body includes non volatile memory in which is stored aplurality of different color values. The control button 1426 is operableto place the pen in a “select” mode, whereby the buttons 1428 and 1430cause the pen to cycle through the available stored values, with thedisplay 1424 displaying the corresponding color to be printed. Thebuttons 1428 & 1430 cause the pen to scroll through the values indifferent directions. The button 1430 may be omitted if scrolling in onedirection is acceptable. Once the desired value is displayed, it may beselected via the button 1426 and the pen will then produce the selectedcombination until it is changed.

Line Attribute Control Via Cycle Buttons

FIG. 25 shows a pen 1432 including a pen body 1434 and a replaceablefour color ink cartridge 1114. The pen body 1434 includes a colordisplay 1436, preferably an OLED, and three control buttons 1438, 1440 &1442. The pen body includes non volatile memory in which is stored aplurality of different line types, such as solid line, dotted line,dot—dash line etc. The control button 1438 is operable to place the penin a “select” mode, whereby the buttons 1440 and 1442 cause the pen tocycle through the available stored line types, with the display 1436displaying the corresponding line to be printed. The buttons 1428 & 1430cause the pen to scroll through the types in opposite directions. Oncethe desired value is displayed, it may be selected via the button 1438and the pen will then produce the selected line type until it ischanged. It will also be appreciated that the line width may be modifiedin a similar manner, with the pen having a number of line widths storedand which may be selected by the user.

Other control models are within the scope of the invention and theinvention is not limited to control of attributes via potentiometers orcontrol buttons.

In will be appreciated that a single pen may provide control of color,line type and line width, and other attributes as desired, with a singledisplay and three control buttons, with the selection button causing thepen to cycle through available attributes, such as color, line type andline width. Additionally buttons may be provided for cycling throughcolor components individually, such as hue, saturation and value

Color Control Via Sampling

Netpage Sensing

FIG. 26 shows a pen 1450 having a four color ink cartridge 1114 and apen body 1452. The pen body incorporates the sensor package 1454described with reference to FIGS. 9 and 10 and which is capable ofimaging a substrate. The pen body includes control buttons 1456 and nonvolatile memory (not shown). The pen is operable to “pick” a color fromany object by “clicking” the stylus nib 1118 against the object eitheralone or in conjunction with pushing an appropriate one of buttons 1456.A color card 1510, shown in FIG. 27 may be provided with a rainbow ofpre defined colors 1512 for use with the pen. The card also includes anarea 1514 for setting the brightness of the color and an area 1516 forselecting a line width and/or style.

The sensor package 1454 may be capable of detecting and decoding netpagetags as described in our earlier application U.S. Ser. No. 09/575,129and a “color card” may be provided with a series of color samples, eachof which is also invisible encoded with netpage type tags. The tags foreach color sample may merely indicate function rather than position,such as “set the color to X” where X is the color of the sample. The penincludes memory in which the function associated with a particular tagcode is stored. To set the pen to a particular color the user merelyclicks the desired color and the pen senses and decodes the tag.

An alternative structure of the color card (not shown) may include twocommand areas. The first area includes tags equivalent to a command of“place in color selection mode” or “pick” mode whilst the second areaincludes tags equivalent to the command of “set the color to the currentcolor”, or “set” mode. To select a color the user may merely “click” onthe first area, click on the desired color sample and then click on thesecond “set” area.

In a further variation the color card may include a series of differentcolors whose values are encoded in a single tag. The card may include anarea encoded with these tags so that a user may click the area andupload a series of colors rather than just one.

Alternatively the tags may operate as in the netpage system where thetags are decoded and transmitted to a netpage server. The serverdetermines the function associated with the tags and transmits anappropriate instruction back to the pen. In this regard reference ismade to the FIGS. 9 & 10 embodiment which includes appropriate hardware(transmitter and aerial) for transmitting and receiving information toan external device.

Where a pen is connected to a computer system the attributes of what isprinted may be set by the user using the computer rather than controlson the pen.

The color card may also include areas which allow the user to set anyother attribute of the line printed, such as line type or line width.

The display may be used to display modal, selection, and statusinformation, including:

-   -   mode name    -   current color/texture for drawing/painting    -   current line width for drawing    -   current brush for painting    -   first few words of current text selection    -   image fragment of current image selection    -   Universal Resource locator (URI) of hyperlink selection    -   pen status (power, communication with printer, etc.)    -   error messages

Sensing with Sensor at Top of Pen

FIGS. 28 to 33 shows a pen 1470 including a replaceable four color inkcartridge 1114. The pen body 1472 includes an optical sensor device 1474at its top end. The pen body includes a color display 1476 and a controlbutton 1478. The display and control button are mounted on a first PCB1480, together with a controller chip or chips 1479. The chip(s) 1479include a small amount of non volatile memory capable of storing a smallnumber of color (or other attributes) samples. The PCB includes contactpads 1483 for contacting with the contact pads of the ink cartridge 1114and for receiving power and controlling the printhead 1120. The sensordevice 1474 is mounted on a second PCB 1482 which engages with contacts(not shown) on the first PCB. Two PCBs are provided for ease ofmanufacturing and a single PCB may be provided on which all componentsare mounted.

The sensor device 1474 includes a chassis molding 1484. This molding isseated in a recess in the internal end of the pen body and is in asubstantially fixed position. There is provided an image sensor capableof sampling any visible color. The sensor 1486 is preferably a RGBphotoreceptor. Other point, line or image sensors may be used.

The molding 1484 includes a recess 1488 in which is located a movementswitch 1490. This switch is sandwiched between the molding and the PCB1483 on which the image sensor 1486 is mounted. The switch 1490 isnormally open but is closed by a compressive force. A lens molding 1492,which includes a lens 1494, is slidably mounted in the end of the penand bears against the PCB 1482. The molding 1492 includes a stand-offring 1496 to prevent the lens 1494 contacting a generally planarsubstrate. Light enters the lens 1494 and is focused/directed onto thepoint, line or image sensor 1486. The lens molding 1492 may be pressedinto the pen, compressing the switch and causing it to change state fromopen to closed. On release of the compressive force the switch urges themolding 1492 outwards.

The color of the line produced by the pen may be controlled in a varietyof ways. As mentioned, the controller chips 1479 are capable of storinga number of different colors. The color to be printed may be selectedfrom the stored colors by use of the control button 1478. The selectedcolor is displayed on the color display. It is also possible to sampleand store custom colors in the memory using the image sensing device1474. The user may “click” the optical sensor device 1474 against asample of the desired color. This causes the switch 1490 to close andthe color detected by the image sensor 1486 is passed to the controllerchip(s) 1479. The controller chip then sets the color to be printed anddisplayed to the sampled color. The user may change colors by “clicking”on a different color sample or by using the control button 1478 toselect one of the stored colors.

Colors sampled with the sensing device may be stored in the memory forlater use. After “clicking” on the sample the user may depress thebutton 1478 to store the sampled color in memory, preferably within apreset time, such as 5 seconds. If the button is not pressed the coloris treated as a “temporary” color and is not stored. The memory may onlybe capable of storing a small number of colors, such as five or ten,storing more colors may be possible but makes selection of the desiredcolor more difficult to the user. Where the memory has reached capacity,the pen may implement one of a number of schemes for deleting a storedcolor to make space for the new color. Deletion may be of the oldestcolor stored, the color least recently used, the color least frequentlyused, etc. Alternatively, the user may be prompted to manually delete acolor and to then resample the color to be stored. Other deletionschemes are within the scope of the invention.

Other modes of operation are possible; for instance, the pen mayautomatically store all sampled colors rather than requiring user input.The pen may provide two or more separate memories (even if there is onlyone physical memory device). A first memory may be used to store“favorite” colors and the second memory for storing “temporary” colors.

The sensor may be used to sample attributes other than color, such asline width and line style.

Line Style or Color Control by Drawing

FIG. 34 shows a pen 1500 having a pen body 1502 and a replaceablecartridge 1114. The cartridge may be a monochrome or four colorcartridge. The pen body includes a control button 1504 and an indicator1506. The indicator may be a single or multi color LED assembly and maybe separate or incorporated into the control button. The pen includescontroller circuitry for controlling the printhead 1120 and non volatilememory for storing attributes of the line printed. The pen has twomodes; a first mode in which it prints the currently selected set ofattributes and a second mode for selecting one of the stored set ofattributes. The pen is normally in the first mode and is set in thesecond mode when a user presses the control button 1504. Preferably thecontrol button 1504 is located on the pen such that in normal use theuser is unlikely to accidentally press the button but it is easilyaccessible. One location is the top 1508 of the pen, although thisrequires two hands to operate. Near the nib area allows operation withone hand.

When in the second mode the pen preferably indicates this by way of theindicator 1506. The indicator may be inactive in the first mode andflash or change color in the second mode. If desired the indicator maybe omitted.

To cycle through the available sets of attributes the user merely drawsa line on a piece of paper or the like. As discussed above, theprinthead is only activated when the stylus nib is pressed on the paper.Thus cycling through the sets can be triggered by the commencement orceasing of drawing. In the preferred form the user draws a line andlifts the pen. The attribute set just drawn is set to the “current”attribute set on “lift off” of the stylus nib. If the user presses thebutton 1504 the pen continues printing with the “current” attribute set,i.e. the line just drawn. If the button is not pressed then on “putdown” of the stylus nib the “current” attribute set is changed to thenext set in the memory and that new attribute set is printed. By drawinglines one after the other the pen is caused to cycle through theavailable attribute sets. The attribute sets may be colors, line widths,line styles or any other characteristic which may be changed, or acombination of such characteristics. The pen may have a number of groupsof attribute sets, such that a first group allows color selection, asecond group allows line style selection and a third group allows linewidth selection, for example. Selecting the appropriate group to modifymay be achieved using the control button 1504. Alternatively, one maycycle through all members of all groups sequentially.

Indirect Printing

Although direct printing of ink onto a substrate is the preferredprinting method, indirect printing is possible. A small Memjet printheadcan be used to construct a universal drawing implement. A smallcylindrical roller is in contact with the page. The roller spins freelyabout the axis of the stylus, so that as the roller is dragged acrossthe page, it automatically orients itself so that it is at right anglesto the direction of motion. The Memjet printhead is mounted behind theroller. It prints onto the back of the roller, and the roller transfersthe printed image onto the page. A small cleaning station cleans any inkoff the surface of the roller after it has contacted the page, so thatthe printhead always prints onto a clean surface. The printheadreproduces a contone color image via dithered bi-level CMY or CMYK. Thestylus can be programmed to produce any colored, textured continuousline or paint stroke. The rate of printing is dictated by the speed ofmovement of the roller relative to the page. This can be determined inseveral ways, e.g., from the actual rotation of the roller, or bycontinuously imaging the surface and detecting movement in the same wayas a second-generation optical mouse, or by sensing and decoding the mapof a self-mapping surface.

The stylus can also be switched into non-marking mode, obviating theneed for both marking and non-marking nibs.

The user can load virtual colors, textures and line styles into theuniversal pen from printed palettes. The stylus can optionally indicateits current settings via an LCD or LEDs.

Stroke Effects

The pen of the present invention is capable of many varied strokeeffects. Some, such as color and line width are independent of time andposition. Others, such as printing a dotted line are dependant on timeand/or relative position of the pen. The FIGS. 9 & 10 embodimentoptionally includes an accelerometer array. This array may be used toderive the relative position of the pen as it moves over a substrate.Thus a dot—dash line may be drawn with equal length dashes despitevariations in pen speed. Many other effects are also possible, theseincluding:

Stroke style

-   -   Color texture (flat, image, procedural)    -   Opacity texture (flat, image, procedural)    -   Nib shape (2D shape, 3D shape, orientation)        -   Determines stroke width        -   Determines “cap” and corner shapes

Varying style with

-   -   Time (speed)        -   Stroke width        -   Opacity (airbrush)    -   Space (including orientation)        -   “Reveal” image        -   “Checkered paint”        -   Dashed line        -   Rainbow colors        -   “Image hose”    -   Location        -   On/off        -   Specific style/current style    -   Tilt        -   3D nib shape

Force (“pressure”)

-   -   Stroke width    -   Opacity (airbrush)

Simulated physics of nib, ink, paper, brush, paint and canvas

-   -   Transfer of ink/paint from nib/brush to paper/canvas    -   Striated brush stroke    -   Layering (stroke on canvas and stroke on stroke)    -   Diffusion    -   Viscosity    -   Mixing    -   Kubelka-Munk color model

Simulated lighting

-   -   Light source direction and color    -   Color physics of media    -   Layering topography

EXAMPLES

-   -   Pen    -   Ball-point    -   Calligraphy    -   Pencil    -   Graphite    -   Color    -   Charcoal    -   Oil paint    -   Water color    -   Crayon    -   Pastel

In this regard reference is made to our earlier applications U.S. Ser.No. 09/112,777, U.S. Ser. No. 09/112,797, U.S. Ser. No. 09/113,091 andU.S. Ser. No. 09/113,054.

Motion Sensing

The embodiment of FIGS. 9 & 10 optionally includes an accelerometer.This accelerometer may be used to provide relative motionsensing/positioning within a pen stroke or a number of strokes. Thismotion may be recorded and used to provide a digital ink record of theuser's strokes. Relative motion sensing may be achieved by other means,such as gyroscopes or use of a rolling ball in contact with thesubstrate.

Absolute positioning within a stroke is more desirable. The pen of FIGS.9 & 10 has netpage functionality—it is capable of detecting and decodinginvisible tags printed on a substrate. This netpage functionalityprovides the pen with the ability to fix its position on a netpageencoded substrate absolutely (and thus absolutely within a stroke) usingthe absolute positioning encoded in the tags. Alternatively, the pen mayrely on the grid based layout of the tags to provide absolutepositioning within the stroke without decoding the tags. Absolutepositioning within the stroke may be achieved using other means, such asimaging the surface of the substrate and using the texture of thesubstrate to detect movement.

As mentioned above, use of netpage tags enables absolute positioningwithin a page. This enables the pen to be controlled by a netpageapplication to mark a netpage surface. The user moves the pen over thepage. As the pen moves it detects tags which enable its absoluteposition on the page to be established. The netpage application controlsthe pen to mark the page according to its position. As such the pen canbe used to “reveal” an image by rubbing the stylus over the relevantportion of the page.

Computer Interface

The pen of FIG. 9 &10 is netpage enabled and has two way communicationwith a netpage server. Using appropriate software it is possible tocontrol the attributes of the marking device from a netpage application.For example, the user may pick a color, a palette of colors, nib stylesor line styles and download these into the pen's memory.

The netpage tags may encode a function or location; the pen may havestored in memory functions, so that the pen can be controlled by sensedtags without the need to revert to a netpage server. Location codeinterpretation usually needs to be carried out by the netpage server.

The netpage system includes a feature referred to as “digital ink”whereby the system records the path of the pen, to enable recordal ofsignatures. The pen of FIGS. 9 & 10 provides the ability to also recordthe “style” of the digital ink. The pen may transmit to the netpageserver information relation to one or more attributes of the visiblemarkings placed on the substrate. These attributes include but are notlimited to color, line width and line style.

Communication of the pen may be by infrared, short range (DigitalEnhanced Cordless Telecommunications, Bluetooth) or long range (CodeDivision Multiple Access (CDMA), Global System Mobile (GSM)) radiotransmission, via a local relay (Bluetooth to mobile phone) or via atemporary or permanent wired connection. A temporary wired connectionmay be useful for downloading an entire palette.

CONCLUSION

Whilst the invention has been described with reference to ink jet typemarking devices, it is to be understood that the invention is notlimited to ink jet type devices or devices which deposit material onto asubstrate. The invention includes devices which alter the substrate,such as thermal printers and electronic paper type (e ink) printers,which change the state of electronically changeable elements of asubstrate. For a better understanding of electronically active inks,reference is made to U.S. Pat. Nos. 6,017,584, 6,124,851, 6,120,839,6,120,588, 6,118,426 and 6,067,185, all assigned to E Ink Corporation,the contents of which are included herein by reference.

It will be appreciated that whilst the embodiments described each onlyinclude some of the features of the invention, some or all of thefeatures disclosed in two or more different embodiments may be combinedtogether.

The present invention has been described with reference to a preferredembodiment and number of specific alternative embodiments. However, itwill be appreciated by those skilled in the relevant fields that anumber of other embodiments, differing from those specificallydescribed, will also fall within the spirit and scope of the presentinvention. Accordingly, it will be understood that the invention is notintended to be limited to the specific embodiments described in thepresent specification, including documents incorporated bycross-reference as appropriate. The scope of the invention is onlylimited by the attached claims.

1. An attribute selection surface for use with a pen having anelectronically controllable marking device and a sensor, the surfacecomprising a substrate having information printed thereon, theinformation comprising: (a) human-readable attribute informationindicative of at least one mark application attribute of the markingdevice of the pen; and (b) coded data adapted to be sensed by the sensorof the pen, at least some of the coded data being indicative of: (i) atleast one mark application attribute of the marking device of the pen;and (ii) a position of a tag on the attribute selection surface, whereinsaid at least some of the coded data disposed within a particular areaof the substrate is indicative of the same mark application attributeindicated by the human-readable attribute information disposed withinthat same area.
 2. The attribute selection surface of claim 1 whereinthe coded data comprises a plurality of tags.
 3. The attribute selectionsurface of claim 1 or claim 2 wherein the mark application attributecomprises one or more of the following mark attributes: (a) colour; (b)stroke width; (c) stroke style; (d) hue; (e) texture; (f) color texture;(g) opacity texture; and (h) nib shape.